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ABSTRACT 


Standard linear quadratic regulator (LOR) designs guarantee a certain level 
of robustness. However, optimizing a generalized quadratic criterion produces 
coupled state and input terms and there are no longer any guarantees of good 
robustness properties. This thesis identifies how this problem arises and then 
presents several suboptimal, but robust controller design options which provide 
the control systems engineer with the ability to perform a trade-off between 
performance and robustness. The effectiveness of these methods is 
investigated and the trade-offs between performance and robustness are 


evaluated using computer simulation of a statically unstable fighter aircraft. 
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I. INTRODUCTION 


Modern weapons systems are becoming more and more complex and are 
constantly pushing the limits of technology. Performance, in terms of agility and 
faster response, are demanded at the same time that reliability and operation in 
a wider variety of environments and applications are required. All of this 
highlights the importance of the design of the underlying control systems of the 
weapon. 

Many times a choice must be made as to the minimum level of reliability or 
robustness acceptable at the expense of a certain amount of performance. For 
a single-input single-output (SISO) linear quadratic optimal control system in 
which there is no cross-coupling of the states of the system and the control 
inputs, there are well defined and guaranteed levels of robustness. However, 
for a multivariable or multi-input multi-output (MIMO) system, while the 
guarantees still apply, the measurement of the robustness of a system is not 
necessarily well defined. In addition, for a system with cross-coupling of the 
states and inputs, which can occur when the performance measure is in the 
generalized quadratic form, there are no longer any guarantees on the 
robustness. An optimized system of this type may be vulnerable to even minor 
uncertainties or deviations from the model used to design the control system. 

Design techniques do exist for working with these problems, but they are 
typically of a graphical nature and do not easily provide a way to measure and 
vary the trade-off between performance and robustness. The goal of this thesis 
then is to develop a design method for using one variable parameter to quickly 


and easily get a measure of this trade-off. The focus will be confined to 


generalized linear quadratic, finite-dimensional, multi-input multi-output systems. 
It is assumed that full state feedback is available so observers will not be 
necessary. In addition, measurement and plant noise will be ignored for this 
development, so techniques such as Kalman filtering will not be necessary. 
After developing several methods for designing suboptimal robust controllers, 
these will be simulated using a statically unstable fighter aircraft which provides 
a convenient MIMO model. Also, the required performance will be chosen 


such that the cross-coupling of the states and the control inputs will occur. 


II. BACKGROUND LINEAR QUADRATIC THEORY 


Standard linear quadratic (LQ) control theory is well understood and many 
tools exist for designing these systems. As long as the states and the inputs are 
not coupled in the performance function, these systems have very good and 
well defined properties of stability and robustness. However, when there is a 
coupling between the states and the control inputs, the robustness of the system 
is no longer guaranteed. This chapter presents a quick review of the pertinent 
aspects of the standard theory, points out where and how the cross coupling of 


the states and inputs occurs, and the problems this creates. 


A. STANDARD LINEAR QUADRATIC CONTROL THEORY 
A linear finite-dimentional time-invariant dynamic system can be described 


in a compact form by input and output equations 
X= Ax-+ Bu, (2-1) 
and 
ses (Cre (2-2) 


where x is an nxJ state vector, u is an mx/ control input vector, y is a pxl 
Output vector, and A, B,C, and D are system matrices of the necessary 
dimensions. Feedback control laws can be used to either stabilize the system 
or modify its response to meet the specifications of a particular application. 
Assuming that all states of the system can be measured, a feedback control 


law is computed as a linear combination of the states 


u=—Kx, (2-3) 


where the feedback gain matrix K is determined from the type of problem and 
the method of control desired. This closed-loop system is depicted in Figure 2.1 
Optimal control is a design method which computes K by minimizing a cost 


function (or maximizing a performance function). The cost function is a real- 





Figure 2.1 Closed-Loop Linear System 


valued function of the state of the system and the control input, both of which 


can vary with time. Cost functions take the general form 
J = F(x), uC), tae. (2-4) 


Application of optimal control requires the specifications of the control problem 
of interest to be formulated in terms of an appropriate cost function. Minimum 
time control, terminal control, minimum control effort, minimum squared error, 
and combinations of these are just a few of the possibilities. 

One cost function which has been found to be particularly useful is 


quadratic control which takes the form 


J = fo [x (e)Ox(e) + uw" (e)Ru(e) ar, (2-5) 


where * denotes the complex conjugate transpose, Q is a positive semi-definite 
nxn matrix, and R is a positive definite mxm matrix. Kalman [Refs. 1&2] found 
that the optimal feedback control law for minimizing this cost function is 


Upp (t)=—RB Px,,,(t) 
=—Kx,,,(t), (2-6) 


where K = R-!B"P is determined by finding a positive definite solution P for the 


Steady-State Riccati Equation (SSRE), 
PA+A P—PBR'B P+Q=0. (21) 


Many algorithms are available for finding P and the feedback gain vector K. If 


the system is completely controllable, P is unique and the closed-loop system 
x =(A-BK)x (2-8) 


will be stable. 


B. ROBUSTNESS PROPERTIES OF LQ DESIGNS 

To design a control system, a mathematical model of the system of interest 
must be developed so that analytical techniques may be applied. Linear 
differential equations (2-1) and (2-2) comprise one such model. In addition, the 
model must be of a form that is accurate enough to give a reasonable 
representation of the system, yet simple enough that it leads to practical 
analytical solution techniques. Unfortunately, no useful mathematical model is 


capable of exactly representing a system. Usually differences will arise from 


non-linearities in a system which is represented by a linear model or from the 
use of first or second order models as approximations of systems with higher 
order dynamics. In addition, parameter variations from operating conditions, 
environmental conditions, measurement errors, etc. may all contribute to 
uncertainties in the operation of the actual plant. 

It is important to design a control system that can perform well over as 
much of the expected range of uncertainty as possible. A system that is 
insensitive to or tolerant of parameter variations and model uncertainties is 
termed robust. For (SISO) systems, robustness is usually measured in terms of 
three parameters (as depicted in Figure 2.2): 


® Gain Margin -- A measure of how much the open-loop gain may be 
increased before the system becomes unstable. 


® Gain Reduction Tolerance (GRT) -- A measure of how much the open- 
loop gain may be reduced before the system becomes 
unstable. 


® Phase margin -- A measure of how much the open-loop phase delay may 
be increased before the system becomes unstable. 





Figure 2.2 Definitions of Robustness Measures [After Ref. 3] 


The optimal control system shown in Figure 2.1 has an open-loop 


frequency-domain transfer function 


G(s)=(sI-A)’B, s=ja@ (2-9) 
and a loop gain 
L(s)= KG(s) 
= K(sI—-A)‘B 
= R’B’P(sI—A)'B. (2-10) 


The robustness of this LQ system can be determined by algebraic manipulation 


of (2-7). First, add and subtract sP and then regroup terms: 


sP—sP+PA+A P+Q-PBR'B P=0 (2-11) 


—P(sI - A)-(-sI - A’ )P+Q—PBR'B P =0. (2-12) 


Then multiply by G*(s) = B*(-sI-A*)-! from the left and G(s) = (sI-A)-1B from 
the right to get 


=B si Aye PB B PGI- Ay B+B Esl—A )e O(sl—A)a!/B 
— B’(-s] — A’)! PBR™'B' p(sI - A)’ B=0 (228) 


Noting that B*P(sI-A)-!B = RL/(s), (2-13) can be rewritten 
—L'(s)R—RL(s)+G (s)QG(s)— L (s)RL(s) = 0 (2-14) 


Or 


[1+ L(s)] R[I+L(s)]}=R+G (s)QG(s). CAS 


Since Q is positive semi-definite and G*(s)QG(s) is quadratic in G(s), the 
right hand side of (2-15) is greater than or equal to R. Therefore, the Nyquist 
plot of this system must remain outside of a unit circle centered at (-/, j0) as 


shown in Figure 2.3. The optimal linear quadratic controller is guaranteed to 


Unit Circle 





Figure 2.3 Robustness of an LQ System [After Ref. 3] 
have an infinite gain margin, at least 60° of phase margin, and a minimum of 


50% GRT. 


C. THE GENERALIZED QUADRATIC CRITERION 

A more general formulation of the quadratic control problem includes 
frequency shaping of the cost function. This allows frequency dependent 
performance requirements to be included in the system specifications. System 


performance can be improved, but robustness may be reduced. 


A frequency shaped cost function can be generated by first transforming 


(2-5) into the frequency domain using Parseval's theorem, 
J=4[" |x" (ja) Ox(jo) + u" (ja)Ru(jo) do. (2-16) 


The frequency shaping is accomplished by making Q and R functions of 
frequency, 


J=4[" |x" (j@)QCjo)x(ja) + u" (jo) Rjo)u( jo) do. (2-17) 


When Q(jq@) and R(j@) meet the additional constraints that they are rational 


functions of j@ and decomposable into 
O(ja) = 0, + TI" (ja)Q5 + O,1I(ja) +11 (ja)0;M(jo), (2-18) 


where II(j@) is a gxn matrix of rational functions of j@ and Q;, Q2, and Q3 are 
nxn, nxq, and qxq, constant matrices respectively, an optimal controller can be 
obtained for this cost function by augmenting the plant to eliminate the 
frequency dependance of the weighting matrices and then applying standard 
LQ procedures. [Ref. 4] 


The augmentation is accomplished by first defining 
x(j@)=II(j@)x(j@) (2-19) 
and 
u(j@)= II(j@)uCjo). (2-20) 


Then 


x= Lz,+ Mx, (2-22) 
and 

25 = Fz, + Hu, (2-23) 

u=Nz,+Ju. (2-24) 


The first term in (2-17) can now be rewritten using (2-18), (2-19), (2-21), and 
(2-22) as 


x ({@)O(j@)x( ja) = x (j@)Q;(jo)x(j@)+ x (J@)IT (j@)Q>x(jo) 
+x (j@)Q1(j@)x(jo)+ x (jo) (jo)O;1a)x(jo) 


= *., a ee QO; QO, x(j@) 
=(x (J) x vay) 6 re 


t.. wee \I MO. OF \ieeO\ Go) 
= * 225 
(x (@) | muri (3 oh | ( ) 


Similarly, the second term becomes: 


Pie: : eons *,. N OFR, RYN Jz) ; 
u (j@)R(j@)u( jo) = (z2(jo) u | ; ‘Le Z| 7 A alc 20) 


Finally, the whole system and the cost function can be written as: 
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and 


where 


meee (DD 
Fatl Zj 22 U ) 
mo 


oo * * * * Q 
=i * 
ATG: Z; Z2 U 1 


5 
R (x Lay 5) u) do, 


Zz, |\+| O lu 
£2 H 
(2-27) 
I, O OV x 
I; O O 
: 1 Naa 
O Ff Py} 22 
0% Wiu 
(2-28) 


I, =Q,+M'Q,+Q0,M+M'Q,M, 


I> =Q,L+M'Q3L, 


[3= LQ3L, 
Y = N’R3N, 


WS = N'R;J +N R), 
Y= Ri + RJ +3 Ro +I RJ, 


Tete C 
Q=|I, I; 0 

0 0 Y, 
Ss =(Onomes 
R= ¥5. 
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) 


Note this state augmentation procedure has generated a cross-state-input 
matrix S which has serious implications for the robustness of this control 
system. The gain and phase margins and gain reduction tolerance of the 


standard LQ system are no longer guaranteed. 


D. ROBUSTNESS FOR A GENERALIZED QUADRATIC 
CRITERION 


The addition of frequency shaping in the cost function generated a cross- 
state-input term. A procedure very similar to those performed on (2-9) through 
(2-15) is developed below to identify the effect of S on the robustness of the 


system. First, the following definitions are made to simplify the expression: 


i 
Te 3) ray (2-29) 
<2 
Furthermore, define 
u’ =—R'B Px, (2-30) 
and 
u=u’ — RS" x. (2-31) 
Then 
x=Axt+ Bu 


= Ax+ B(u’ — R™'S*x) 
=(A—BR’S”)x+ Bu’ 
= A’x + Bu’. (2-32) 
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From (2-28), 


x Ox+x SutuS xt+u Ru 


=x" Ox+x'S(u’ —RUS"x)+(u’- RUS x) S'x 


+(u’ — R?S*x) R(u’ — RUS’ x) 
=x (Q-SR?’S )x+u’ Ru 


* me 
=x O’xt+u’ Ru. 


Using the above definitions, the SSRE becomes 


PA’+A’P+Q’-PBR'B'P 
= P(A—BR™’S )+(A— BRS )*P+Q 
—~SR‘S’ —PBR ‘BP 


= PA+A P+Q-(PB+S)R‘(PB+S) =0. 


Finally, 
u=u' —R7?S'x 
=—R7’B Px-—R™'S*x 
=-R/(B P+S )x, 
and 


K=R7(B P+S )=R/(PB+S) 


(2-33) 


(2-34) 


(2-35) 


(2-36) 


Now, given the modifications as in (2-29) through (2-36) the analysis of the 


System proceeds just as in the standard LQ case: 


G(s)=(sI—A) 7B, 
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(2-37) 


and 
L(s) = KG(s)= K(sI- A)’ B. (2-38) 
Using (2-36), 
L(s)= R™!(PB+S) (sI-A)7B. (2-39) 


Adding and subtracting sP to the SSRE and rearranging yields 


~P(sI—A)—-(sI—A )P+Q-(PB+S)R@(PB+S) =0. (2-40) 


Multiplying from the right by G(s) and from the left by G*(s) and rearranging 


terms as was done in (2-14) and (2-15) results in 
[1+ L(s)] R[ 1+ L(s)]=R+ G (s)OG(s)+S°G(s)+G(s)S. (2-41) 


Comparing (2-41) with (2-15), there are two new terms as a result of the 
cross-State-input matrix §. The standard optimal LQ system was guaranteed 
an infinite gain margin, 50% GRT, and 60° of phase margin. If these two new 
terms in (2-41) result in reducing the magnitude of the right hand side, they will 
effectively reduce the robustness of the system. Of course, the converse may 
also be true. In some systems, the right hand side may be increased and 
robustness will correspondingly increase. The effects of S will depend on the 


particular system and the required frequency shaping in the cost function. 
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lil, MODEL UNCERTAINTY AND ROBUSTNESS 
MEASURES FOR MULTIVARIABLE SYSTEMS 


Multi-input multi-output (MIMO) systems introduce significantly greater 
complexity into the control design problem. The additional inputs and outputs 
provide a designer with much more flexibility in the solution to the problem of 
stabilizing a system, but they also complicate the subject of defining the 
robustness of the system. This chapter presents some concepts used for 


MIMO systems and develops the robustness measure to be used for this thesis. 


A. MODEL UNCERTAINTY FOR MIMO SYSTEMS 

Since no design model will exactly match the physical plant, it is important 
to consider these model uncertainties for control system design. The form used 
in representing them depends on the degree to which the physical mechanisms 
of the uncertainties are understood or known. In general, representations can 
be placed into two categories based on the amount of structure in the 
uncertainty. Highly-structured representations are those in which the amount of 
parameter variation can be confined within well defined limits for models at 
various operating points. An example would be the aerodynamic coefficients of 
a missile for different altitudes and velocities. Less-structured representations 
usually place bounds on the uncertainty of the plant transfer function. Doyle 


[Ref. 5] gives two general ways of representing this: 
G'(j@) = G(j@)+ AG(jo), Ga) 


where 
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o[AG(jw)]<1,(@) for V@20 (3-2) 
and 
G'(j@) = G(jo)[1+ ACjo)], Ge) 
where 
o[A(ja)|<1,,(@) for V@20. (3-4) 


The maximum singular value o is defined by 


6[A] = max|Az| = \Amnax |” A] (3-5) 


Neither (3-1) and (3-2) nor (3-3) and (3-4) attempt to give any indication of the 
causes of the uncertainties. The additive uncertainty representation, (3-1) and 
(3-2), bounds the matrix G' within a region Jg. about G The multiplicative 

uncertainty representation, (3.3) and (3-4) (which is preferred here since it 
applies the same uncertainty to both uncompensated and compensated transfer 
functions), confines the matrix G’ to a normalized neighborhood, Jj, about G 
This type of uncertainty can be incorporated into the system model as shown in 
Figure 3.1. Knowledge about and experience with the uncertainties affecting a 


particular system are the determining factors in the magnitude of /y. 
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Figure 3.1 System with Unstructured Uncertainties 


B. ROBUSTNESS MEASURES FOR MIMO SYSTEMS 

Many methods have been investigated and developed for measuring the 
robustness of MIMO systems. The principal region and minimum singular 
value techniques will be discussed here. 

1. Principal Region 

Postlethwaite [Ref 6] has developed a method of extending the gain 

and phase margin concept to MIMO systems through the definition of a 
principal region. The principal region is found by polar decomposition of the 


loop transfer matrix L(s): 


L(s) = U(s)HpR(s) (3-6) 


and 


L(s) = H(s)U(s), eo) 


where U(s) is unitary and Hp(s) and H,(s) are positive semi-definite Hermitian 
matrices with the same eigenvalues. Principal gains (or singular values) are 


defined as the eigenvalues of Hpr(s) or H;(s) and the principal phases are 
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defined as the phases of the eigenvalues of U(s). The maximum and minimum 
principal gains, Omax and Omin, and the maximum and minimum principal 
phases, @max and @min, for each s, form a curvilinear rectangle in the Nyquist 
plane. Combining all the rectangles for values of s on the Nyquist D contour 
forms the principal region. A gain margin, phase margin, and gain reduction 
tolerance can be defined, as depicted in Figure 3.2, at the boundary of the 


principal region. 


Principal Region 





Figure 3.2 Principal Region and Stability Margins for MIMO 
systems [After Ref. 4] 
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This method generates graphical information which does not easily 


lead to defining a single parameter which may be used to adjust performance 


and robustness. However, the use of just the minimum singular values, while a 


more conservative approach, provides similar robustness information and does 


lend itself to the goal of this thesis. 


2. Minimum Singular Value 


A measure of the robustness of a system with the uncertainties 


described above can be obtained as follows: 


z=KG(/+A)e 
and 
e=r-Z 
Then 
e=r-kKG(I+A)e, 
(1+ KG([+A))e=r, 
and 


e=(1+KG(I1+A))@r 
=(1+KG+KGA)?r 
= [1+ KG) + (1+ KG) KGA)] *r 


=[1+(1+KG)" KGA] (1 +KG)'r. 
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(3-8) 


eC) 


(3-10) 


(3-11) 


(3-12) 


Using the small gain theorem and (3-12), a sufficient condition to 


guarantee closed-loop stability is 


| (1+ KG)" KG |-|| Al|<J G13) 
or equivalently 
o| (GEKGY KE |-o A he (3-14) 
Using (3-4), 
o| (SKQa KG <= (3-15) 


m 


Equation (3-15) can be written in a more convenient form using some results of 


matrix theory. First, 


(1+ KG)’ KG=(4K@Gpe. (3-16) 
so (3-15) becomes 
a|(I+(KGy"y"|< = (3-17) 
and, using 
ae (3-18) 
o[A]’ 


equation (3-17) becomes 
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1 1 


o|1+(KGY"] an a? 
or 
of1+(KG)"] >In. (3-20) 
Therefore, the robustness measure to be used here is defined as 
J, = o|1+(KGy"|, (3-21) 


i.e., Jp iS the minimum singular value for the system in the frequency range of 
interest. Jy is a single number which gives a measure of the robustness of the 
system. For the standard optimal LQ system, J; is guaranteed to be 2 0.5. 
Therefore, the robustness of a system can be computed and directly compared 
to the standard optimal system and a determination made as whether or not it is 
Satisfactory. 

As Stated before, this method is very conservative. There are the 
Same number of singular values as the dimension of the system and it is unlikely 
that the uncertainties in the model will affect the whole system equally across 
all the states. Therefore, some models may very well have much more 


robustness than what is predicted by this method. 
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IV. ROBUST SUBOPTIMAL DESIGN 


The general idea for the suboptimal robust design is to trade off optimality 
(1.e., performance) for a greater degree of robustness. In the case of the 
generalized linear quadratic control system, this means computing the feedback 
gains, K = R/(PB+S) , by modifying Q, R, or S in (2-41). 

A number of design possibilities exist and seven options investigated under 


this thesis work are presented below. 


A. ROBUSTNESS DESIGN OPTIONS 
Equation (2-41) is repeated here as it serves as the basis for evaluating 


robustness: 
(lee LY REPL) =R+G OG+S GEG S: (4-1) 


Where L and G are understood to be functions of s = jq@. In addition, using the 


relation 
(R+SG) R7(R+S G)=R+SG+GS+GSR'S G, (4-2) 
equation (4-1) can be rewritten as 
(1+L) RU+L)=G (Q-SR"S )G+(R+SG) RU(R+SG). (4-3) 
Note that the right side is guaranteed to be greater than or equal to zero if 


O=-SRUS 20. (4-4) 
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The greater the right side of (4-3) the better the robustness and it certainly 
needs to be greater than zero to guarantee stability. All options are presented 
using a tilde, ~, to indicate the modified parameters. 
1. Option I: S=0 
The first option is to simply ignore the cross-state-input matrix by 


setting § =S=0. Equation (4-1) would be reduced to 
(I+L) RU+L)=R+G QG, (4-5) 


which is the same as (2-15) for the standard LQ situation. However, this is just 


a special case of option IV. 
2. Option Il: Q=Q+SS°, R=R+I 


These substitutions yield 
(1+L) RU+L)=R+GOG+SG+GS (4-6) 
Or 
(1+ L)(R+D(I+L)=R+G OG+(14+S G) (1+SG). (4-7) 


Here the terms on the right hand side have either been forced into quadratic 
forms or are positive, ensuring that robustness is improved. 
3. Option III: R=pR 
This is a straight-forward introduction of a multiplicative parameter 


into (4-1) which gives 


Cea eR@ah) = eG OG aS iGaiG.S 
=pR+GOG+SG+GS (4-8) 
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Or 
(1+L) R(I+L)= R+(G'OG+S'G+ G'S). (4-9) 


As p is increased, the right side approaches R. If the robustness of the 
system had originally been degraded by S, theoretically, the best that could be 
achieved by this option is exactly the minimum guaranteed by the standard LQ 
system. 

4. Option IV: S=pS, p<1 
As in option III, this is also a simple substitution using a multiplicative 


parameter. This time, however, it is applied directly to S: 


(1+ LY RGU+L)=R+G OG+S G+GS 
=R+G Q0G+p(S G+GS) (4-10) 


Note that when p=0, (4-9) reduces to 
(1+L) R(1+L)=R+G QG, (4-11) 


the standard optimal LQ case and option I is therefore, a special subset of this 
option. 
5. Option V: R=pR, Q=Q+(p-LDSR'US, p21 
Substituting into (4-3): 


(1+ L) R(I+L)=G [O-SR'S ]G+(R+SG) R7(R+SG). (4-12) 


This results in 
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(1+ L) pR(I+L)=G"[Q+(p-2)SR™'S 1G 
+(pR+S'G) (pR)/(pR+S G) (4-13) 


Or 


(I+ LY RU+L)=—G'[0+(p-2)5R'S"1G 


HR+25°GY R? (R+~5°G). (4-14) 
p p 


As p is increased, (4-14) approaches 
(1+ L) RU+L)=R+G SR'SG. (4-15) 


Again, the term with S has been made quadratic in order to improve 


robustness. 
6. Option VI: Q=pQ 


Here, a simple substitution of a multiplicative parameter into (4-3): 


(1+L) RUI+L)=G [Q-SR?’S |G 
NERS IG ORE SG) (4-16) 


Or 


(1+ L) RU+L)=G [pQ-SR™'S |G 
CR SG Mie Cen sG (4-17) 


Note that the right side 1s guaranteed to be greater than or equal to zero only if 


pQ-SR™"S >0. (4-18) 


ES 


For optimal LQ theory, Q is only required to be positive semi-definite. For this 
option, there is no guarantee that pQ-—SR™“S can be made greater than zero 
unless Q is positive definite. 
7. Option VII: Q=Q+pSR'S, p21 
Substituting Q into (4-3) yields: 
(+L) RU+L)=G'[Q-SR™"S |G 
+(R+S°G) R“(R+SG) 


=G'[Q+(p-1)SR'S' |G 
+(R+S G) R?’(R+SG) (4-19) 


Again, the right side is greater than or equal to zero for p2 J. 

This list certainly does not exhaust the possibilities, but it does provide many 
avenues for investigation of the robustness of an MIMO system optimized by a 
general quadratic criterion. It should also be noted that when Q, R, or S is 


modified, the control system is no longer optimal. 
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V. A NUMERICAL EXAMPLE AND SIMULATION 


To explore the utility of the theory so far developed, a numerical example 
will be presented and the control systems using the various options in the 
preceding chapter will be designed and simulated. The model to be used is the 
one used by Chen [Ref. 3]. The development and explanation of this model is 
briefly summarized here. The simulations will use a wind gust as the 
disturbance input to the system to test the transient response of various 


suboptimal designs. 


A. STATICALLY UNSTABLE AIRCRAFT MODEL 

The model for this simulation is the F-20 Tigershark designed by Northrop 
Corp. The aircraft is designed to be extremely agile, and as a result, is highly 
unstable in the absence of a control system. In addition, the simulation will be 
based on a special flight mode called fuselage-pitch-pointing (FPP) mode. The 
fuselage-pitch-pointing concept provides the ability to alter the pitch without 
changing the flight path (Figure 5.1). Another interesting flight mode called 
direct lifting (DL) is shown in Figure 5.2, where the aircraft's altitude can be 
changed without changing the pitch. 

These are not the intuitive ways of flying an aircraft and therefore, would 
not be the normal modes of operation. Instead, it might be used in special 
circumstances such as bombing runs or during dogfights where the ability to 
rapidly change altitude or pitch of the aircraft independently may provide 
significant advantage over an adversary. In addition, the FPP mode provides a 


good MIMO model for investigating robust, suboptimal controller design. 


44) 


Se Path 





Figure 5.1 Pitch Pointing, Constant Flight Path 





Figure 5.2 Direct Lifting, Constant Pitch 


A linearized pitch-axis model for the F-20 at Mach 0.5 and an altitude of 
10,000 feet is: 


&] [-0.834 0.996 Of a] [-0.2 -0.093). . 
g\=| 2.755 -0.89 Ollg|+|-11.4 2.03 | (5-1) 
6 0 1.0 ole 0 0 6 
04 
y=|q |. (5-2) 
g 
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The state variables are angle of attack @, pitch rate g and pitch angle @, as 


shown in Figure 5.3. 


O 


Flight path 


ee —————————— 





Figure 5.3 Definitions of State Variables a, q, and 6 
The two control inputs are stabilizer position 6, and trailing edge flap position 
of. This model has three poles located at s = 0, -2.519, and 0.795. 

The design problem is to develop an FPP control system that will reject 
turbulence and yet provide good robustness. This thesis will focus on a 
regulator type of control which will endeavor to maintain the states of the 
system at desired values in the presence of disturbances to the system. An 
appropriate frequency-shaped quadratic cost function which accomplishes 


these objectives is 





| 2 
J.={" [15002 +97 +50(0-a)+| —2@~ | (6240.0482)ldw. (5-3 
-={ [15007 +q? +50(6-@) (2) (ai 2)] (5-3) 


Turbulence is typically manifested by disturbance at frequencies < 30 rad/sec. 


Therefore, the cost function is designed with a high pass filter on the control 


dy 


inputs to allow greater control effort at low frequencies and to penalize control 
effort at higher frequencies. In addition, flight path angle y= 0 — & is heavily 
weighted to limit deviations from the flight path. Turbalance however, is a 
transient phenomenon, therefore this optimization focuses more on rejecting 
these transitory disturbances in pitch rate, pitch, and angle of attack than on 
Steady-state deviations from the flight path. 

For this problem, the frequency dependent weighting matrix on the control 


is selected to be 


hme a 
R(jo) =| \J°* 79 (5-4) 





- 


and it can be readily decomposed into 


jo jo 











ee O —— 0 

Cen 30 aD ease | Sasi) 

0 0 0 j@_10 0} [0 O}} 4g jo 
J@+ 30 Ja+30 

J@ 0 j@ 
jo+30 10 O | j@+30 
i" jo F 0.04 jo | 

J@+ 30 J@+30 


which meets the criteria of (2-22). 
Following the augmentation procedure described in Chapter II, this system 
can be expressed in a frequency-independent format. First, expand the input 


terms of (5-3) into the form: 


30 








S 














5 5 10 60 Op, 
on 2-5 s+30 — |, 5-6 
a " 5+30 ar _ Ss : 
S+30 f 
Now define 
S 30 
ig a el Fe 57 
ea ( =) " | 
and let 
= 30_ 5, 
s+ 30 (5-8) 


This results in the new state equations: 


Z, = —30z, + 306, (5-9) 
and 
Uy =—2, + O,. (5-10) 
Similar steps for dy result in: 
Z2 = -302, + 306, (5-11) 
and 
Uy = —Z2 + Of. (5-12) 


Thus the new augmented system 1s 
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a] [0.834 0.996 0 0 
g DUES AOS ald 0 
@l=| O TO 0 O60 0 || @ 
ar 0 0 60 0 

0 


z, | 0 0 0 —30.0 2, 
—0.2 —0.093 
—11.4 2.03 
O;, 
+4 O 0 | (5-13) 
Of 
30.0 0 
ho 30.0 


and the frequency-independent cost function is 


J,=J, [a q @ z 2 O, 5,| 


200 0 -50 0 0 O O 
0 1 0 O05 670 a 

-30 0 50 0 0 0 0 | @ 

10 0060 1 oO - O ald “Gay 
0 0 0 0 0.04 0 -0.04]| z, 

000 -1 0 FI oO 46, 

0 0 0 0 -0.04 0 0.04 | 6; 
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B. SIMULATIONS 

The simulations will use a vertical wind gust with a maximum velocity of 
62.5 feet per second. This disturbance 0 will be introduced into the system as 
shown in Figure 5.4. The wind gust effectively changes the direction of the 


incident wind and consequently the angle of attack of the aircraft, as indicated 


in Figure 5.5. 





Figure 5.4 Wind Gust Disturbance Inputs 


Flight path 


Wind gust 





Figure 5.5 Angle of Attack 
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All performance J; and robustness J; values for theses simulations are 
computed using the rectangular wind gust. For comparison purposes, the 
optimal system response is presented first. 

1. Optimal System 


Optimization of this control problem results in 
_[-11.1747 -1.2199 -0.5267 -0.3593 -0.0169 
| -37.0471 3.1484 35.2571 -0.6706 -0.50021 


J. = 3.9678, 

J, = 0.3529, 
and Figure 5.6 shows the minimum singular values, as defined in (3-21), as a 
function of frequency. Note that within the range of frequencies expected for 
turbulence (< 30 rad/sec), the plot drops below 0.5. Figures 5.7 and 5.8 show 
that the response to turbulence is quite good. However, with a robustness of 


0.3529, GRT is only 35 percent, leaving a much reduced margin for errors or 


109 
@ (rad/sec) 





Figure 5.6 Minimum Singular Values of the Optimal System 
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Figure 5.7 Response of the Optimal System to a Rectangular Gust 
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5.8 Response of the Optimal System to a Triangular Gust 


Figure 
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uncertainties. A suboptimal design will be able to trade off some of the desired 
performance in order to recover greater tolerance of model and parameter 
error. 
2. System with O=Q+SS", R=R+I 
This simple modification to Q and R results in the singular values 


shown in Figure 5.9, with 
_[-6.2110 -1.2014 -1.9775 0 -0.0008 
~|-5.1028 0.4075 6.3684 0 -0.0179) 


J, = 11.1382, 
J, = 0.8049. 





@ (rad/sec) 


Figure 5.9 Minimum Singular Values Using Q=Q+SS, R=R+I 
This is a significant increase in robustness. Unfortunately, it also produces a 
significant loss of performance, as depicted in Figures 5.10 and 5.11. There is 
nearly an order of magnitude increase in pitch angle, at least twice as much 


pitch rate, and a significant drop in response time. Additionally, there is no 
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adjustable parameter available for selecting some intermediate point between 


this and the optimal system. 
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Figure 5.11 Triangular Gust Response of QO =Q+ Ss", R=R+I 
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3. System with R=pR 
This option provides for adjustment of the amount of trade off. As can 
be seen in Figures 5.12 and 5.13, some improvement in robustness is obtained, 


but the maximum for this system is only 0.4583 for p= 3.4. This option appears 


to provide very limited and insufficient improvement. 





Figure 5.13 Robustness vs p for R=pR 
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4. System with S=pS, p<1 
This option appears to hold great promise. Comparing Figures 5.14 
and 5.15 with 5.12 and 5.13, this scheme provides significantly greater increase 


in robustness for a much smaller loss of performance. Moreover, the use of a 


simple multiplicative parameter p allows control engineers to adjust the amount 





Figure 5.15 Robustness vs p for S=pS, p<il 


BS, 


engineers to adjust the amount of trade-off. Figures 5.16 and 5.17 demonstrate 


the response to the two disturbances. 
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Figure 5.16 Square Gust Response for S=pS, p<1 
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Figure 5.17 Triangular Gust Response for S=pS, o<1 
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5. System with R=pR, Q=Q+(p-1)SR'S, p21 
Figures 5.18 and 5.19 show that although J; does get above 0.5, there 
is still limited improvement for the increased cost. Apparently applying the 


modifications directly to the control weighting matrix provides little benefit. The 


responses to the disturbances are presented in Figures 5.20 and 5.21. 





Figure 5.19 Robustness vs p for R=pR, Q=Q+(p-1)SR'S’, p21 
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Figure 5.20 Rectangular Gust Response for 


Q+(p—-1SR'S*, p>1 


R=pR, Q= 
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Figure 5.21 Triangular Gust Response for 
R= oR, O= Q+(p—1)SR'S’, p21 
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6. System with Q =pQ 
From Figures 5.22 and 5.23 it appears that the cost is increasing nearly 
linearly with p. However, for 1 < p < 5 the robustness increases dramatically 
while the cost only goes up to about 25. This isn't as good as using option IV, 


where the cost increased far less for a comparable increase in robustness, but it 


does show increased robustness with a variable parameter. Figures 5.24 and 


EEE 








Figure 5.23 Robustness vs p for Q=pQ 
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5.25 show that the responses for both types of disturbance are still quite good. 


Angle of Attack (deg) 


Pitch Angle (deg) 


Pitch Rate (deg/sec) 





0 0.5 | 1.5 2 Pa 3 3.5 4 
Time (sec) 


Figure 5.24 Square Gust Response for 0=pQ 
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Figure 5.25 Triangular Gust Response for Q=pQ 
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7. System with Q= Q+pSR'S", p21 
Figures 5.26 through 5.29 show that this option gives excellent results, 
similar to and slightly better than option IV. Using p = 10 gives a robustness of 
nearly 0.8 and increases the cost to only about 11.7. It would appear that 


options IV and VII would be the best choices for suboptimal robust control 


design. 





Figure 5.27 Robustness vs p for Q=Q+ pSR™'S", p21 
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Figure 5.28 Square Gust Response for Q@ 
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Figure 5.29 Triangular Gust Response for Q 
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C. FURTHER INVESTIGATION OF OPTION IV 
As shown in the previous section, this suboptimal design displayed 
significant promise. In this section, the effects of p are further studied. 


Equation (2-32) is repeated here: 


lee CeO ix 


a 


=e * * *¢  & Yr; 0 0 <] 
We eon Z, iz ae) : d@ 
2 | aa 0 0 bs a Y, £2 
0 0 WH Whu 
oo * * * * Q S 
=f" (xz) 2 U 1s ae Zy Zp uy da. (1.3) 


It is evident that multiplying S by p is in effect multiplying Y by p. But, 
Y= N'RJ+N R5, (5-16) 


and therefore 
pv, = p(N RJ +N R;) 
=pN RJ +pN R> 
= N’R3J + Nee (Sag) 


Since N is produced by the augmentation of the inputs as given in (2-28), the 
physical result then, is a modification of II(j@), the frequency shaping of the 
control inputs. 

For the aircraft system in this example, (5-10) and (5-12) give 


uj, = Nz, + JO, 
=~z,+0, (5-18) 
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and 


Un = Nz ar Joy 
=—Z2 + Of. (Sai) 


Working backwards through the augmentation procedure, 





s Gesepee ree 
a. mln |i 


s+ 30 
-( rs (5-20) 
s+30 : 
and 
aera 
= eee 5-21 
4 ( s430 JS oa 


For p=1, (5-20) and (5-21) reduce to the original high-pass filter and the 
resulting response and robustness are those of the optimal system. Decreasing 
p to -1 in several steps alters the frequency shaping as shown in Figure 5.30. 
Evidently, this aircraft system is more robust if low-pass filtering is used on the 
control inputs. 

Another interesting point is that p had to be limited to [-1, 1] for this 
system. Outside these limits, Q=Q-SR™“S was no longer positive semi- 
definite as required by optimal control theory to ensure a stable close-loop 


system. 
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Figure 5.30 Frequency Shaping as a Function of p 
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VI. CONCLUSION 


The frequency shaping in the generalized quadratic cost function can be 
converted to the standard linear quadratic control form by state augmentation. 
However, this process generates coupling between the states and the control 
inputs and eliminates the guaranteed good robustness characteristics of LQ 
optimal designs. This thesis has explored and developed a design technique for 
improving the robustness of these systems. This technique involves 
modification of the stability equations to regain robustness at the expense of 
optimality. The following modifications were studied: 

® OptionI: S=0 

* Option II: Q=Q+SS°, R=R+I 


~~ 


« Option II: R=pR 

* OptionIV: S=pS, p<1 

¢ Option V: R=pR, Q=Q+(p—1)SR'S’, p21 

* Option VI: O=pQ 

* Option VI: Q=Q+pSR7US*, p2=1 
All of these involve modifications to the weighting matrices in the cost function. 
The unstable aircraft model used in the simulations in this thesis responded best 
to Options IV and VII. 

This thesis provides control systems designers with the ability to perform a 
trade-off between optimized performance and robustness. This is accomplished 


through the introduction of an adjustable parameter in the governing stability 
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equations. This approach provides a direct and straight-forward tool which 
designers can easily apply to their specific control problems. 
In addition, some areas identified for future research include: 


# Analysis of the physical meaning of the changes made by each of the 
design options, similar to that done in Chapter V for Option 
IV. 


* More comprehensive comparison of all the options with each other to 
identify their similarities and differences in response for 
various values of p. 


* Study of the effectiveness of this technique for systems in which 
observers or Kalman filters are necessary due to the use of 
partial state feedback. 


a> 


[1] 


[2] 


[3] 


[4] 


[3] 


[6] 


REFERENCES 


R. E. Kalman, “Contributions to the Theory of Optimal Control,” Pol. Soc. 
Mat. Mex., Vol. 5, pp 102-119, 1960. 


R. E. Kalman, “When is a Linear System Optimal?” Trans. ASME, J. 
Basic Eng., Vol. 86, pp 1-10, 1964. 


W. Z. Chen, “Constrained Optimization Approach to Feedback Control of 
State Augmented Systems,” Ph.D. Dissertation, University of California, 
Los Angeles, California, 1990. 


W. Z. Chen, “Parameter Optimization for an H, Problem with 
Multivariable Gain and Phase Margin Constraints,” presented at the 
American Controls Conference, Chicago, Illinois, 24-26 June 1992. 


J. C. Doyle and G. Stein, ’Multivariable Feedback Design: Concepts for 
a Classical/Modern Synthesis,’ IEEE Trans. on Automatic Control, Vol 
AC-26, No. 1, pp 4-16, 1981. 


I. Postlethwaite, J. M. Edmunds, A. G. J. MacFarlane, “Principle Gains 
and Principle Phases in the Analysis of Linear Multivariable Feedback 
Systems,” TEEE Trans. on Automatic Control, Vol. AC-26, No. 1, pp 32- 
46, 1981. 


56 


ee) 


INITIAL DISTRIBUTION LIST 


Defense Technical Information Center 
Cameron Station 
Alexandria, Virginia 22314-6145 


Library, Code 52 
Naval Postgraduate School 
Monterey, California 93943-5000 


Chairman, Code EC 

Department of Electrical & Computer Engineering 
Naval Postgraduate School 

Monterey, California 93943-5000 


Prof. Won-Zon Chen, Code EC/Cw 

Department of Electrical & Computer Engineering 
Naval Postgraduate School 

Monterey, California 93943-5000 


Prof. Jeffrey B. Burl, Code EC/BI 

Department of Electrical & Computer Engineering 
Naval Postgraduate School 

Monterey, California 93943-5000 


Prof. George Thaler, Code EC/Tr 

Department of Electrical & Computer Engineering 
Naval Postgraduate School 

Monterey, California 93943-5000 


Lt. Kurtis B. Miller 
Navy Undersea Warfare Center, New London Detachment 
New London, Connecticut 06320 


Harold M. Miller 
2314 Bennett Ave. 
Glenwood Springs, Colorado 81601 


Kenneth E. Smith 
109 Bluegrass Dr. 
Schererville, Indiana 46375 


57 


No. Copies 
Z 











DUDLEY KNOX LIBRARY 


NAVAL PUnTGRADUATE SCHOOL 
MONTEREY CA 93943-5101 





DUDLEY KNOX THT 
| 


ORNS et yet He i pote | f i ERENT) | ny ¥ l 
sana ee BT 
Rae malted baat ven Semi pace thy , WALT HITT | | | WA 
othe hae omnemmramanemmmi NILA AU NIMAAMMA MAMAN AMAA 

: Re ‘. i ih whet Oa ; ish : ; 


| 
| | 
768 00308606 7 


| 
| 
tae 
ink ee bere he 
Nh &y Ate, 
PE OA Kas e 7. 
Ete Nt ab ie 


ote 


“ BE bears 


: bite. 5 Cy ¢ hh 4,0 
yoy ant". gt ¥ ' ¢ Utes; 
‘ 1 : ' 4p? 
weet “st ; A ' 


Ute ites 


i) 


; Mbigaee wt 
cos ea > | 


= a4 
>. 


~ 


> o®, 
Yi 


re 
eo = 


* sf beprg! 
1 


oh bh ps 
enn aiveae 
¥ 


OUR ages Pr 
es 
ey 


My 


ae | 
4p) 


~~ 


Ae Hd oy ras 
+ 47) . 
ree 


ae 
ws 


so o™ hay 
o"olb i. Seed 
Tony 


v wove 
wae 


Peay ‘ 
eee 


ran? © a Me 


oe day, 
, wet te 
Bs 1 6 


piearsisa 

St teen oat Be 
a” 

. “Ty 

Cosi te rs 

r 7s bE LDD 

; i fe 

entity 

>” Sat ey 


Cai Pege yg pc, Be 8 
~ re Geis MIE. 5 "ert 
“tap, y 3 oo? LS ee 
Megha Se ores 
ald Tgite A 
‘ ‘- 
${> 2300) yode ee 
0 A +t 
ee e & q J ‘ ’ U } es 
Tt a> X DSyrsey 5 . y R , 
Mefe2 5 SISn Sie 


= BP eesebay 
pile ; : 
MP each aye ‘ gle oe 
AUI® seek iste ot 2 “ caer ents 
. 
ey ete ae 


In 
UL aeg te] 


out oNrE 
Vibes «ap 

Clos Tl Bits Ges 

"**b lee 


ep es 


44 he 

’ Geo 8 as wha" @ ney 

Le pee vine 
Mgt ege nes 

{ “eihtee *. 


7S tuyp 
oY *2 


’ 
Oe pe 
He 


lL geet * ‘ 
Pert 
by pies 


4 
a 


, © 
em ; 
SP ray 
.T 
4 RN I hh ads 
+t 
Wile 


K 


<3t 
u oS it afee 
Fe! totorst 1 ae 


eer tar 
ate ta. Be ge 
tu Sgt tgs 
‘4 . 


‘i 


hme, 


Bx 





